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The Multidimensional Moment Problem with 
Complexity Constraint 
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Abstract. A long series of previous papers have been devoted to the 
(one-dimensional) moment problem with nonnegative rational measure. 
The rationality assumption is a complexity constraint motivated by ap¬ 
plications where a parameterization of the solution set in terms of a 
bounded finite number of parameters is required. In this paper we pro¬ 
vide a complete solution of the multidimensional moment problem with 
a complexity constraint also allowing for solutions that require a sin¬ 
gular measure added to the rational, absolutely continuous one. Such 
solutions occur on the boundary of a certain convex cone of solutions. In 
this paper we provide complete parameterizations of all such solutions. 
We also provide errata for a previous paper in this journal coauthored 
by one of the authors of the present paper. 
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1. Introduction 

The multidimensional moment problem considered in this paper amounts to 
finding a nonnegative measure dfj, on a compact subset K of solving the 
equations 



( 1 . 1 ) 


k = 1,2 ,... ,n 


where ci, C2,..., c„ are given numbers and oi, 02,... On are given linearly 
independent basis functions defined on K. More precisely we are interested 
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in measures of the type 


d^(x) 


P{x) 

Q{x) 


dx + dfl{x), 


( 1 . 2 ) 


where P and Q are nonnegative functions on K formed by linear combinations 
of the basis functions and dfl is a singular measure. 

Such constraints are nonclassical and motivated by applications. An 
important special case is to find an absolutely continuous measure 


= T^dx (1.3) 

Q{x) 

satisfying (11.1(1 . where P and Q are as in (11.2(1 . Clearly ((1.311 is a complexity 
constraint depending on a finite number of parameters. 

In the one-dimensional case, (generalized) moment problems with the 
complexity constraint don has been considered in a long series of papers 
[SHsmsHn]. This study started with the rational covariance extension prob¬ 
lem, which is a trigonometric moment problem with rational positive measure 
formulated by Kalman [22) . i.e., ai, q; 2 , ... q;„ are the trigonometric monomi¬ 
als, k = 0,1,..., n — 1. In this case, given moments ci, C 2 ,..., c„ that 
admit solutions of dmi, it was shown in [T^lIIJ] that there exists a solution 
for each choice of positive P, and in [5] it was established that this pa¬ 
rameterization of the solution set is complete and smooth, i.e., the map from 
P to Q is a diffeomorphism. A constructive proof based on a certain family of 
convex optimization problems was given in [T|[51li]. These results were modi¬ 
fied in steps to the case that ai, a 2 , ■ ■ ■ an are Herglotz kernels in 
leading to Nevanlinna-Pick interpolation with positive rational measure and 
more general moment problems with complexity constraints [Hl-IHl lIIllT^ldfi) . 

In this paper we begin by generalizing certain results in concerning 
moment problems over the general class of measures (O to the multidimen¬ 
sional case (d > 1), but we shall also take a fresh look at the case d = 1. 
However, when allowing P and Q to have zeros in K, the class of measures 
have to be extended to Unfortunately, a key result for this case in [6] is 
incorrect, and we take the opportunity to provide a correction in this paper. 

The multidimensional moment problem is important in many applica¬ 
tions, such as imaging, radar, sonar, and medical diagnostics [101 EH[32] . A 
series of papers by Lang and McClellan [28(1291131] are of special interest to us, 
since in a certain sense they provide an interesting overlap with the theory 
described above. For this reason we shall have reasons to return to some of 
their results in the rest of this paper. 

The outline of the paper is as follows. In SectionE]we define the general 
multidimensional moment problem and introduce a set of dual cones that will 
be fundamental in the subsequent results. We present a generalization to the 
multidimensional case of a theorem by Krein and Nudelman [2fil p. 58] on the 
existence of solutions to the moment problem. In Section[3]we generalize some 
basic results in for moment problems with rational measure to the multi- 
variable case, and in Section]?] we introduce the basic optimization problem. 
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generalized to the multivariable case, and prove the basic parameterization 
result in the rational case. In Section we extend the parameterization to 
the general case when, e.g., P and Q are allowed to have zeros in K, result¬ 
ing in solutions of the form (ll.2|l . In Section [6] we consider the case when 
the moments are placed on the boundary of the feasible set. Section [3 is an 
appendix to which we have deferred some supporting results and proofs for 
better readability. Finally, Section [5] contains errata for [^. 


2. The general multidimensional moment problem 

Let {ai,a 2 , ■ ■ ■ ,an} be a set of real-valued, continuous functions defined on 
the compact set K We assume that K has an interior of dimension d, 

the closure of which is precisely K. The functions ai, 012 , • ■ ■, Q!„ are assumed 
to be linearly independent, an assumption that will be retained throughout 
the paper. This condition holds in most interesting moment problems, as, for 
example, the trigonometric moment problem, Nevanlinna-Pick interpolation 
and the power moment problem. 

Given real numbers ci, C 2 ,..., c„, we shall consider the (truncated) mo¬ 
ment problem to determine a bounded nonnegative measure dfi such that 
HU holds. Whenever convenient, we shall write (HH) in the vector form 



where c = (ci, C 2 ,..., c„)' and a = (ai, 02 , ■ ■ ■, «„)' are column vectors and 
prime (') denotes transpose. 

The assumption that the basis functions are real can be done without 
loss of generality. In fact, in the case of complex basis functions (as, for exam¬ 
ple, in the trigonometric moment problem) and complex moments, we merely 
exchange a complex moment equation with two real moment conditions [5]. 

Next we define the open convex cone C H." of sequences p = 
{pi,P 2 , ■ ■ ■ ,Pn) such that the corresponding generalized polynomial 

n 

P{x) = '^Pkak{x) (2.2) 

fc=i 

is positive for all x = {xi,... ,Xd) G K. Moreover, we denote by *11+ its 
closure and by 5fp+ its boundary *11+ \ tp.).. It is easy to see that F = 0 if 
and only ii p = 0, since ai,a 2 , ■ ■ ■ ,an are linearly independent. 

Throughout the paper we assume that the zero locus of P has measure 
zero for each p G fp+ \ {0}. Again many important moment problems, even 
in the multidimensional case, have this property. 

Moreover, we define the dual cone 


£+ = {c e R" I {c,p) > 0 for all p G \ {0}}, 


(2.3) 
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where (c,p) is the inner product 

n 

{c,p) = '^CkPk- 


k=l 


Proposition 2.1. The dual cone £+ is nonempty if ^ {0}. 
Proof. Take c = adx. Then, for any p G \ {0}, we have 

{c,p) = X] / ^kPkdx = / Pdx > 0. 


(2.4) 


k^l 


fK 


f K 


However, due to the continuity and linear independence, P ^ 0, and hence 
there is always a small neighborhood in which P > 0. Consequently, the 
inequality in (US is strict for all p G \ {0}, and hence c G £+. □ 

The dual cone £+ is also an open cone, and we denote by £+ its closure 
and by i9£_|_ its boundary. 

Proposition 2.2. Any c G K" satisfying (12.11) for some nonnegative measure 
dp belongs to £+. 

Proof. If c satisfies (12.11) . then 


(c,p) = 

fe=i 

for all p G Hence c G £+, as claimed. 


' akdp = / Pdp > 0 

K Jk 


□ 


The converse also holds. The proof of the following generalization to the 
multidimensional case of a result in Krein and Nudelman [261 p. 58] is based 
on Theorem 15.11 and will be deferred to Section [51 

Theorem 2.3. Suppose that tP-). 0. Then for any c G £+ there exists a 

bounded nonnegative measure dp such that (EH) holds. 

This theorem ensures that the space 

> 0 I J ad^ = c|’ (2-5) 

of bounded measures is nonempty for all c G £+. However, in general, there 
are inhnitely many solutions, and the extreme points of SUtc are of particular 
interest. 


Proposition 2.4. Suppose that 0. Then, for all c G C+ there is a 

dp G SUIc that is a discrete measure with support in at most n points in K. 

Proof. Following the proof of Proposition 6 in El] , we use the Krein-Millman 
Theorem to show the existence of an extreme point, and then we show 

that any extreme point has the claimed properties. The space SOlc is the 
intersection of a positive cone and a closed subspace, and hence it is convex 
and closed. Let p G Then P(x) > e for some e > 0, and hence {c,p) = 
Pdp > ep{K). Therefore the norm (total variation) of the elements of 
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DJtc is bounded by {c,p)/e, which implies that 9Jlc is compact in the weak* 
topology [H p. 19], Then, since DJtc is a compact convex set in a locally 
convex topological linear space, it is the closure of the convex hull of its 
extreme points [T9l[25]. Since the set DJtc is nonempty (Theorem 12.3|1 . it has 
at least one extreme point. 

We want to prove that the extreme points of DJlc have support in at most 
n points. To this end, suppose the contrary. Then there is an extreme point 
dfi = Pkdpk for which the measures dpk > 0 have distinct support and 

Pk >0, fc = 1,..., n + 1, and therefore 


c = 



/ a[dpi ■ ■ ■ dpri+i] 

■ /3i ■ 

J K 

Pn+1_ 


Since a[dpi ■ ■ ■ dpn+i] G has linearly dependent columns, there 

is a nontrivial affine set of solutions {/3fe}, which contradicts the assumption 
that dp, is an extreme point of 9Jlc. Hence the extreme points of dJlc has 
support in at most n points. □ 


Corollary 2.5. The extreme points of SJlc have support in at most n points. 

In several of the most important one-dimensional moment problems 
there are matrix tests available to check that c G £+. For example, in the 
trigonometric moment problem, we need to check that the corresponding 
Toeplitz matrix is positive definite, and, in the Nevanlinna-Pick interpolation, 
that the Pick matrix is positive definite. There is also a matrix test for the 
power moment problem in terms of a Hankel matrix [26) . 

In the multidimensional case, checking that c G £+ is more complicated, 
but the following result might provide some help. 

Proposition 2.6. Let cq G £+ be arbitrary^ Then the optimization problem 

min (c,p) subject to {co,p) = 1 (2-6) 

pe^p+ 

has a solution with minimal value V. Moreover, (i) P > 0 if and only if 
c G £+, (ii) V = 0 if and only if c € 9£+, and (hi) V < 0 if and only if 
c ^ 

Proof. The constraint {co,p) = 1 is a hyperplane that does not pass through 
the vertex of the cone *11+ where p = 0. Since, in addition, cq G £+, the 
hyperplane has a compact intersection with and therefore the linear 
functional (c,p) has always a minimum there. Then the rest of the proposition 
follows directly from the definition (12.311 . □ 


^For example cq = fj^ cidx S as in the proof of Proposition 12.11 
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As a preamble to the solution of the fundamental optimization problem 
of Section [5l it is instructive to consider the dual problem of (12.61) . Differen¬ 
tiating the Lagrangian 


L{p-,dn,X) = {c,p) - / Pd/r-A((co,p) - 1), 

Jk 

where the nonnegative bounded measure]^ dp S C{K)* and A are Lagrange 
multipliers, we obtain 


c — c — Aco = 0 


where c := 



and the complementary slackness condition 


(2.7) 


(c,p)= [ Pdp = 0, (2.8) 

JK 

which implies that c € Since P > 0 on K and dp is a nonnegative 

measure, (j2.8ll also implies that dp is either identically zero or a singular 
measure with support in the set of zeros of P. Inserting the stationarity 
condition (1^ in the Lagrangian we get the dual functional [30] 


p{dp,X) = {c,p) + X{co,p) 
Consequently, the dual problem is 



Pdp — A(co,p) -I- A = A. 


max A subject to c — Xcg G i9£+ (2.9) 

A^K 


with optimal value A. Since these are convex optimization problems and 
7 ^ 0, there is no duality gap m, and therefore X = V. From this we 
can construct an alternative proof of Proposition [121 In fact, since c G d€+, 
it follows from (j2.7l) that c G d€+ is equivalent to Acq G which in turn 
holds if and only if A = 0, since cq G £+. Increasing A through positive values 
brings c = c+Xcg into £+, whereas negative values of A brings c = c+Xcg out¬ 
side £+. This could be compared with the test procedure suggested in [171 P- 
3.2.4]. 

Using a homotopy approach, it was shown in [16] that a certain differ¬ 
ential equation has an exponentially attractive point if and only if c G £+. 
Such a procedure might be preferable from a computational point of view. 


3. Solutions with rational positive measure 

We begin by considering rational positive measures of the type 

dp=^dx, p,qG^+ (3.1) 

and define the moment map 

fP{q) = ( a^dx. (3.2) 

JK V 


^The dual space of C(A'), denoted by C(iC)*, is the space of bounded signed measures m- 
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The following condition is instrumental in ensuring the existence of an 
interpolating measure of the form for each given p G fp+, which, as we 
will see, leads to a complete and smooth parameterization in terms of rational 
measures. 


Condition 3.1. The cone is nonempty and has the property 

j -T^dx = oo for all q € cl*P+. (3-3) 

JK Q 

The following modification of Theorem l2.3l is a simple corollary of Theo- 
rem l3.4l below. but we state it already here to motivate our interest in rational 
measures iu. 

Proposition 3.2. Suppose that Condition \3.1\ holds. Then there is a dp G DJtc 
of the form iH) satisfying (EH) if and only if c G £+. 

This is immediate by taking any p G^+ in Corollary 13.51 

Lemma 3.3. Suppose that Condition \3.1\ holds and that p G fp+. Then the 
map fP : —>■ £+ is proper, i.e., the inverse image {f^)~^{C) is compact 

for every compact C C £+. 

Proof. We first prove that {fP)~^{C) is bounded. To this end, first note 
that the set {{c,q) \ c G C,q G *$!+, H^Hoo = 1} is compact, and hence the 
bilinear form (c, q) has a minimum e there, where e > 0 since C C £+. Hence 
{c,q) > e||g||oo. However, 

{F{q),q) = [ Pdx =: K 

JK 

is constant. Consequently Halloo < k/e for any q G {fP)~^{C), proving bound¬ 
edness. If {fP)~^{C) is empty or finite, it is trivially compact, so let us assume 
that it contains infinitely many points. Let (q^) be any sequence in such 
that fP{q^) G C for all k. Since iF)~^iC) is bounded, has a cluster 
point q in the closure Compactness of {fP)~^{C) now follows from the 
fact that q ^ In fact, if g € d^+ were the case, we would have 

{F{q),p) = f ^dx = oo 
JK V 

by the assumptions p G and Condition 13.11 which contradicts the fact 
that snp]^{fP{q^),p) < sup^gp{c,p) is finite. □ 

Theorem 3.4. Suppose that Condition \3.1\ holds and that p G fp+. Then the 
map fP : —> £+ is a diffeomorphism between and £+. 


Proof. Since p G fp+, the Jacobian 

dfP 


dq 


= — a-^a'dx < 0 


IK 


Q 


on all of fp+. In fact, for a G K", the quadratic form 


dq 


a = — {a'a) 

JK 




(3.4) 
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if and only if a = 0. Since is also proper iLemma 13.3p . it follows from 
Hadamard’s global inverse function theorem [5U] that the map is a diffeo- 
morphism. □ 


Corollary 3.5. Suppose that Condition AS. 1\ holds. Then the moment equations 

Ck= I ak^dx, k = 0,l,...,n (3.5) 

Jk W 

have a unique solution q S for each {c,p) G £+ x 

Remark 3.6. As demonstrated in [5], Condition l3 .1 I holds in the one-dimensional 
case if the basis functions (ai, a 2 , ■•■,««) are Lipschitz continuous. In fact, if 
q G i9fp+, there is an a:o G AT such that Q{xo) = 0. Therefore, if Q is Lipschitz 
continuous, there exists an e > 0 and a k > 0 such that Q{x) < k\x — xo\ for 
all X G [xo — e, xq -|- e], and hence 


f 

r°+" dx ^ 

^ pxo+e 

dx 

Jk Q 

0 

1 

m 

0 

1 

^ JXQ—e 

0 

1 


This is a very mild condition, since any reasonable moment problem encoun¬ 
tered in applications would have Lipschitz continuous basis functions. Also, 
if (oi, a 2 j ■ • ■ j ttn) is a Chebyshev system (or T-systemj^ and contains a con¬ 
stant function, then after a reparameterization the basis functions will be 
Lipschitz continuous [Ml P- 37]. 

In the multidimensional case, the situation is a bit trickier. As was noted 
in [ini p. 819], Condition 13.11 always holds if K is an interval in and the 
basis functions (a^) are twice differentiable and doubly periodic. However, 
as the following example from [M] illustrates, this does not hold for d > 3. 

Example 3.7. Let K := [—7r,7r]‘^ and ak{x) = cosxfc, k = 1,2,. ..,d, and set 


d 

Qi^) = “ COSXfc), 

k^l 


which corresponds to a g G since <5(0) = 0. However, this is the only 
zero of Q, and hence, in checking Condition 13.11 we need only consider a 
small neighborhood = {x G AT j ||x|| < e} of x = 0. A series expansion 
shows that for sufficiently small e > 0 we have 1 — cosxk > on all of 

D^, and hence 

f dx f dx 

Id, Q ~ Jd, 

Changing to spherical coordinates, this becomes 



'Vd-1=0 Jip=0 




sin If dr dip dpd-i, 


where p := {pi,..., Pd- 2 ) and sin 1,5 := sin'^ pi - ■ ■ sin(^£;- 2 - This is clearly 
finite for d > 3, and hence Condition [Q does not hold in these cases. 


set of real functions (ai, 0 : 2 ,, oin) on an interval [a, b] is called a Chebyshev system 
if any nonzero linear combination P(x) = at most n zeros |26l p. 31]. 
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Example 3.8. Next consider a one-dimensional case where a is not Lipschitz 


continuous. Let a{x) = (1,and K = [—1,1]. Then q = (0,0,3) S 
9tp+. In fact, Q{x) = 3x^/^, and hence Q(0) = 0. However, 



(3.6) 


so Condition 13.11 is not satisfied. In this case, £+ is not a dif- 

feomorphism, so we have a counterexample to the statement of Theorem l3.4l 
with Condition 13.II removed. In fact, is not even continuous in all points. 
Take p := (1,0,0) G and a sequence qk ■= 3(fe“^, 1) G which 

tends to qoo ■= (0,0,3) as fc —)> oo. Then P = 1 and Qk{x) = 3(a;^/^ -f 
and hence P/Qk P/Qoo = for all x ^ 0. However, by (13.6L 

/[(loo) = P/Qoodx = 2, whereas 



1 



/ 


[x^/^ + k-^)-'^dx 


-1 


-1 


for all k>l. Consequently, is not continuous in g = (0,0,3). Moreover, 


we observe that the substitution y = x^/^ transforms the basis to a{x) 


(l,x,x^), which is Lipschitz continuous. However, now P(x) = x^, and hence 
p G 9fp+, so this is not a counterexample to Theorem 13.41 We may even 
modify this example so that ff{qk) < oo for all finite k. To this end, choose 
qk ■= 3{k~‘^ + k~^, 2k~^, 1), which again tends to goo := (0, 0,3). However, it 
can now be shown that 



as /c ^ oo, which again shows that is not continuous. 

4. The optimization problem 

Next, given the moment map (EH), following we construct the 1-form 




on fP 4 .. Taking the exterior derivative (on fp+) we obtain 



i.e., the 1-form lj is closed. Therefore, since is an open convex set and 
hence star-shaped in any point, lo is exact by the Poincare Lemma |391 pp. 
92-94]. This means that there exists a smooth function JJ); on such that 
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with the integral being independent of the path between two endpoints. Com¬ 
puting the path integral, one finds that 

^^( 9 ) = (c,<?) - / PlogQdx (4.1) 

JK 

modulo a constant of integration. Then, for each (c,p) € £+ x \ {0}) we 
extend the functional (HU) to a map —>■ M U { 00 }. 

Lemma 4.1. Let {c,p) G £+ x \ {0}). Then the functional JJp : *11+ —R 
is strictly convex. 


Proof. First observe that 


dq 


= c- r{q), 


and consequently, in view of dSH), the Hessian ]HI(g) of Jp is given by 

H(<z) = -^( 9 ) = / a^a'dx, 
oq Jk Q 


where the integrand PjQ^ is nonnegative. Since by assumption the zero locus 
of P has measure zero, PjQ^ is zero at most on a subset of K of measure 
zero, and consequently > 0 for the same reason as in the proof of 

Theorem 13.41 This implies that is strictly convex. □ 


Lemma 4.2. The map ^ R zs lower semi-continuous on all o/fp+. 

Proof. Let (qk) be a sequence in converging to g G in Loo-norm. 
Since the functions {Qk) and Q are continuous on a compact set Lf, the 
convergence Qk —>■ Q as fc —?> 00 is uniform. Since Q is a continuous function 
on a compact set, maxa, Q < 00 . Moreover, since the convergence is uniform, 
we have that supj, max^, Qk < 00 . Hence there is an M such that max^, Q < M 
and supj, max^, Qk < M, and thus 

-log(^)>0 and -log > 0, fc = 1,2,.... 

Therefore, by Fatou’s lemma, 

■ X ‘°® (s) ■ /* (^) 

since Qk —>■ Q pointwise. Consequently, Jp(g) < liminffc_).oo Jp(9fc), proving 
that JJp is lower semicontinuous. □ 


Lemma 4.3. The sublevel sets of 1° are compact, i.e., the inverse image 
(JJp)“^(oo, r] is compact for all values ofr. 

Proof. By Lemma 17.11 in the appendix we have 

r > Fpiq) > edlQIloo - Cp log ||Q||oo, 

and by comparing linear and logarithmic growth we see that the sublevel sets 
are bounded from both above and below. Since they are sublevel sets of a 
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lower semi-continuous function fLemma l4.2p . they are closed. Hence they are 
compact. □ 

Theorem 4.4. Let {c,p) S £+ x (*11+ \ {0}). Then the functional (14.11) has a 
unique minimum in Moreover, the map : tP-|_ \ {0} —^ sending p 

to the corresponding minimizer q is continuous and injective. If, in addition, 
Condition AS. 1\ holds and p € tp+, then the minimizer q belongs to tp+. 

Proof. By Lemma 14.31 there exists a minimizer q G tp+. Since 1° is strictly 
convex (Lemma 03} i this minimizer is unique. Injectivity of the function g‘^ 
follows from a trivially modified version of the proof of Lemma 2.4 in [6]. 
Continuity of g^ is proved in the appendix lProDOsition l7.,l() . If Condition 13.II 
holds and p € the functional (14.11) has a stationary point in the open 
cone (Theorem 13.4L which must then be identical to q. □ 


We note in passing that, for (c,p) € £+ x tp+, the convex optimization 
problem to minimize JJp over all q G is the dual of the problem to maximize 

Ip($) = j P{x)\og^{x)dx (4.2) 

J K 

over all $ € T+ satisfying the moment condition 

/ a{x)^{x)dx = c, (4.3) 

JK 

where 3”+ is the class of positive functions in Li{K). In fact, we have the 
following duality result. 

Theorem 4.5. Suppose that {c,p) G £+ x and that Condition \S.1\ holds. 
Then the optimization problem to maximize (03} over all $ G 3'+ satisfying 
the moment condition (03} has a unique solution 

Q 

where q is the unique minimizer o/JJp. Moreover, 

Ip(l>) = J^(g) + f Pi\ogP-l)dx. 

JK 

Proof. Given Lagrange multipliers q = {qi,q 2 ,... ,qn), form the Lagrangian 
L(4>, q) = Ip($) ^ gfe ( Cfe - / ak^dx ) 

k=l \ / 

= Ip(<l)) -I- (c, g) - [ Q^dx, 

JK 

which is finite for any fixed q Setting the Frechet differential 
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for all (5$, we obtain the stationary point $ = P/Q, which inserted into the 
Lagrangian yields 

L[P/Q,q)=Fp{q)+ [ PilogP -l)dx. 

JK 

Since $ n- q) is concave for any q £ we have L(<f’, q) < L{P/Q, q) 
for all $ € 1L-I-. However, by Theoreni l4.4l there is a unique q € such that 
$ := P/Q satisfies (14.31) . namely q, and hence 

Ip(4>) = L($,g)<L(P/Q,g)=Ip(l>) 

for all <!>€?'+ satisfying (IQ) . proving the required optimality. □ 


The choice P = 1 yields the maximum entropy solution of the moment 
problem. This duality has been extensively discussed in in the 

one-dimensional case. In the special case of trigonometric basis functions, the 
multidimensional case was already covered in naiMiisi], but in a more gen¬ 
eral framework of weighted maximum entropy optimization which does not 
consider parameterization of rational solutions and related issues, something 
that is important in our present context. 

The duality result of Theorem 14.51 relies on Condition 13.11 and will be 
reformulated in Section [SJ where this condition will not be required. In this 
case the optimal solution may contain a singular part, that is, be of the form 
(11.21) (Theorem 15.21) . 

Theorem 4.6. Suppose that Condition \3.1\ holds and c £ £+. Then the map 
restricted to fp+, is a diffeomorphism onto its image 0+. 


Proof. Since g‘^ is continuous and injective (Theorem 14.41) . 0+ is an open set 
of the same dimension as (p+. By definition, g^ : ^ 0+ is also surjective. 

Next define the function 


ip{p,q) = c- [ a^dx. 

Jk w 


Then the moment equations (stationarity condition) can be written (p{p, q) = 
0. Since 


dip 

dq 


[ a^a'dx 

Ik 

is positive definite on all of x the Implicit Function Theorem implies 
that q = where g'^ is continuously differentiable. Moreover, 

-1 


dg^, . 


f P 
/ a-^a'dx 
VJk Q 




is positive definite, since 

^iP,q) = -[ a^oi'dx 
dp Jk Q 

is negative definite. Hence, by the Inverse Function Theorem, the inverse 
function is also continuously differentiable. Consequently, g^^ : —> 

0+ is a diffeomorphism. □ 
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Together with Corollarv l3.5l Theorem l4.6l vields a complete parameteri¬ 
zation of all solutions of the rational moment equations (uni). This generalizes 
to the multidimensional case the corresponding results in [^, which in turn 
are generalizations of the results in [9] . 

If g G it follows that q ^ 0+ := C and hence, by 

Theorem l4.6l p ^ tp+, and thus p G 9fp+. This yields the following corollary. 

Corolljiry 4.7. Suppose that Condition \3.1\ holds, c G £+, and P/Q satisfies 
the rational moment condition (liOl . Then q G 9^-(- implies that p G . 

Note, however, that the converse is not true. In fact, a g G 90+ could be 
contained in tp+ as the following simple one-dimensional example shows. Let 
K = [—7r,7r], ai = 1 and a 2 = cos a:, and suppose that P{x) = 1 — cos a; and 
Q{x) = 1. Then c = (1, —1/2). Since c has a positive definite Toeplitz matrix, 
c G £+. Moreover, since 0(0) = 0, p G 9*P+, and therefore, by Theorem 14.61 
q = (1, 0) G 90+. However, clearly q G fp+. 

Moreover, again Condition 13.II is crucial. In fact, in Example 13.81 where 
this condition does not hold, q G 9tp+ whereas p G *P+ is in the interior. 
However, under the variable substitution y = which makes the basis 

Lipschitz continuous so that Condition 13.11 holds, p moves to the boundary 

d^+. 


5. Solutions on the boundary 


If Condition 13.11 holds and p G ip+, then Sp has a unique minimum in the 
open cone *13+, which solves the moment equations (13.51) . On the other hand, 
if these conditions are not satisfied, the minimizer may end up on the bound¬ 
ary 9*P+, leading to complications described in [551151] for the special case of 
rational covariance extension. Therefore, in the present more general situa¬ 
tion, the constraint Q{x) > 0 becomes essential for solving the optimization 
problem. 


Theorem 5.1. Let {c,p) G £+ x (*13+ \ {0}). Then there exists a unique pair 
{c,q) G 9£+ X (*P+ \ {0}) such that 

Ck = I ak^dx + Ck, fc = 0, l,...,n. (5.1a) 

Jk Q 


Here 


Ck= Oikdjx, fc = 0,1,... ,n, (5.1b) 

Jk 

where dfl is a (not necessarily unique) singular bounded nonnegative measure 
such that supp(d/i) C null((5), i-e., the support of the discrete measure djl is 
contained in the set of zeros of Q. The vector q is the unique minimizer of 
eu over *13+. 


Proof. Since Q G C{K), Lagrange relaxation leads to the Lagrangian 

L{q, p) = Ipiq) - [ Qdp, 

Jk 


(5.2) 
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where q S tp+, and where the Lagrange multiplier dfi G C(K)* is a nonneg¬ 
ative measure. Then setting 


dL 
dqk ' 


{q,fi)=Ck- [ at^dx - [ akdfi, k = 1,2,... ,n 
JK Q JK 


equal to zero, we obtain (15.11) for the saddle point {q, fi) [50]. By Theorem l4.4l 
the minimizer q is unique. Then it is seen from (IS.lal) that c is also unique. 
Now, by complementary slackness [301 Theorem 1, p. 217], 


Qdfi = 0. 


(5.3) 


JK 

Since the optimization problem is convex with a strictly feasible point, the 
KKT conditions (i) q G *P+, (ii) djj, nonnegative bounded measure in C{K)*, 
(hi) dSU and (iv) (lOI) are necessary and sufficient for optimality. Since 
Q > 0 and d/t > 0 on K, (ESI) can only hold if the support of d/t is contained 
in the set of zeros of Q. However, such zeros exist only if g G 

It remains to show that c G 9£+. To this end, first note that, in view of 
the representation (IS.lbl) . c G £+ (Proposition 12.21) . Moreover, by (15.31) . 


and hence c G 9£+. 


(c, q) = i Qdjl = 0, 


IK 


□ 


We are now in a position to generalize the duality relation from Theorem 
14.51 to the more general setting where Condition 13.11 is no longer required. 
Thus we extend the domain of the objective function Ip of the primal problem 
to include any nonnegative measure dji and define 

Ip(d^) = j P{x)log^{x)dx, (5.4) 

JK 

where d/r = ^(x)dx+d(L is the unique Lebesgue decomposition of the measure 

m- 


Theorem 5.2. Let {c^p) G x \ {0}) be given. Then the problem to 
maximize dEl over the set of nonnegative measures of bounded variation, 
subjeet to the moment condition dni), has a solution on the form 


d/r 


Pjx) 

Q{x) 


dx + dpi. 


where q G tP-i- \ {0} and dpi is a singular bounded nonnegative measure such 
that supp(d/l) C null((5). 


Proof. Following the same path as in the proof of Theorem 14.51 we now 
consider the Lagrangian 


L{d^i, q) = lp{dp) + '^qk (^Ck - J ak{^dx + dpi) 

= / P(a:) log $(a;)da;-|-(c, g) — / Q^dx — / Qdpi. 
JK JK JK 
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Note that for {dfj,, q) to be a saddle point it is necessary that q G and 
supp(d/i) C null(Q). This means that the last term must disappear for any 
saddle point candidate, and we are therefore left with a function that is 
identical to the Lagrangian in the proof of Theorem 14.51 The proof then 
follows along the same lines as that of Theorem 14.51 Also note that the 
existence of djl is ensured by Theorem 15.II □ 

It is interesting to note that the functional (15.411 is concave but not 
strictly concave, since the value does not depend in the singular part d(l. 
Therefore it is not surprising that the optimal singular measure d(l is not 
guaranteed to be unique. Moreover the function (15.41) can in fact be seen as 
a Kullback-Leibler-like divergence index between the two measures dp(x) := 
P{x)dx and dp,{x) |18j . In fact, maximizing (15.41) is equivalent to minimizing 
P log (T’/4>) dx, and, since dp is absolutely continuous with respect to dp, 
we have the Kullback-Leibler-like divergence 

SKL{dp\\dp) ■= j log dp = J Plog^^^ dx, 

where [dp/dp) = P/$ is the Radon-Nikodym derivative [37l p. 553-554]. 

For later reference we collect the KKT conditions of Theorem (STj in the 
following corollary. 


Corollary 5.3. Let c G £+. Then q is the optimal solution to 


if and only if 


min Il{q) 


q G *P+, c G d<t+ 
f P 

Ck= ak-^dx + Ck, k = 0,l,...,n 
JK Q 

(c, g) = 0 


(5.5) 


(5.6a) 

(5.6b) 

(5.6c) 


Note that c = 0 whenever q G fp+, since then Q{x) > 0 on all of K. This 
is the situation of Corollary 13.51 If q G 9fp+, we have supp((i/l) C nulpQ). 
Although c in (IS.lbl) is unique, the measure dp may not be unique in general, 
as can be seen from the following examples. 


Example 5.4. Next we provide a one-dimensional example where dp is not 
unique. Let AT = [0,1], ai = 1 and a 2 {x) = (1 — a:)( cos (p^) +l)- First note 
that 012 ( 1 ) := hma;_,.i 02 ( 2 :) = 0, and thus 02 is continuous on all of K. Since 
02 (x) G [0,2] for all x € K, we have = {q G > 0, 92 > 

Now take c = ( 2 , 7 )', where 7 := Jj^a 2 dx. Since 02 > 0 but not identically 
zero, 7 > 0. Moreover, 


7 < 



da; -I-1 < 2. 


Hence 0 < 7 < 2. Let q G fp+\{0} be arbitrary. If qi = 0, we have q 2 > 0, and 
hence (c, q) = 792 > 0. If qi > 0, we have (c, q) = 2qi + 752 > (2 — ^)( 7 i > 0. 
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Therefore (c,q) > 0 for all q S \ {0}, and hence c € £+. Next taking 
P = Q = a 2 , we have P{1) = <5(1) = 0, i.e., p = q = {0, 1)' € Then 
forming 

r P 

Cl = Cl — / ai—dx = 2 — 1 = 1 

Jo Q 

dx = j — j = 0 

{c,q) = qi > 0 for all q € *11+ \ {0}, and hence c S £+. Moreover, {c,q) = 
(?i = 0, so c G Consequently, by Corollarv l5.3l q is the minimizer of 1°, 
and hence the support of the measure dp in (|5.1bp is contained in null((5) = 
null(Q: 2 )- However a 2 (t) have infinitely many zeros, and any measure dp = 
dx + dp such that p{K) = 1 and supp{dp) C null((5) is a solution. 


P 

C2 = C2 — / Ct2^ 

Jo Q 


Example 5.5. It is easy to construct a small two-dimensional example for 
which the measure dp, representing c, is not unique. Let K = [0,1]^ and 
a(x) = ( 1 ,xi,X 2 ,X 1 X 2 )', and define 


c = 



a—dx + c, 

Q 


where P{x) = xi, Q = xi(l -I- X 2 ), and c = aS(xi)dx = (1, 0,1/2, 0)'. 
Clearly c G £+ and g G *P+. Moreover, c G d€+. In fact, 

xiS(xi)dxi / (I-|-X2)dx2 = 0. 

Jo 

Therefore (c, q) satisfies the KKT conditions (15.61) and is the unique mini¬ 
mizer of Jp (Corollary [531) ■ However, null((5) is the whole line xi = 0 , and 
any measure dp with mass 1 and support constrained to xi = 0 such that 
Jj^X 2 dp = 1/2 is a solution. Hence there are infinitely many ways to select 
dp. 



Condition 5.6. The vectors a(xi), a(x 2 ),..., o;(xm) are linearly independent, 
where xi,X 2 , - ■ ■ ,Xm are the points where the optimal polynomial dUD have 
zeros, i.e., Q(xj) = 0. 

Proposition 5.7. Suppose that Condition 1 5. 61 holds. Then the measure dp in 
Theorem no is unique. Moreover, 

m 

dp = ''^^aj6{x — Xj)dx (5-7) 

1=1 

for some oi,..., a™ G M", where m < n. 

Proof. Inserting ([53 into (IS.lbl) yields 

m 

Cfc = J2<^k{xj)aj, 

1=1 
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which has a unique solution (ai, 02 ,..., Om) if C({xi),a{x 2 ), ■ ■ ■ ,a{xm) are 
linearly independent. □ 


Remark 5.8. In the one-dimensional case {d = 1), a(xi), a{x 2 ), ■ ■ ■, a(xm) are 
linearly independent for all distinct points xi,X 2 , ■ ■ ■ ,Xm such that m < n — 1 
in any T-system |231I26] . for example, the trigonometric and power moment 
problems, and also the Herglotz basis used in Nevanlinna-Pick interpolation. 
In these cases the zero set of Q will always satisfy the linear independence 
property of Proposition 15.71 resulting in a unique dfl. 


Theorem 5.9. Let (c,p) € £+ x \ {0}). Suppose that Condition \5. hi holds 
for the minimizer Q of dSS]) and let dp = P/Qdx + dp be the unique cor¬ 
responding measure in (lOl) . Moreover, let {pk) be a sequence in tp_|_ such 
that Pk ^ p as k ^ 00 , and let dpk = {Pk/Qk)dx -\- dpk be measure (15.61) 
corresponding to the minimizer of Then dpk —>■ dp in weak* as fc —> 00 . 

Proof. We want to show that 

/ fdpk / fdp 

JK JK 

for an arbitrary / G C'(IC). We may choose p(x) = r'a{x) so that p{x) = f{x) 
for X G null((5). In fact, since a(xi), Q:(a; 2 ),..., cx.{xm) are linearly indepen¬ 
dent (Condition [SHI), it follows that the system of linear equations 

r'[a(xi) a{x 2 ) ■■■ a{xm)] = [fixi) /(X 2 ) ••• /(x^)] 

has a solution. Then, setting g = f — p, null((5) C null(( 7 ). Moreover, since 
dpk and dp both satisfy the moment condition (EB, we have pdpk = 
pdp = (c, r), and hence it is sufficient to show that 


gdpk 


IK 


9 dp. 


Ik 


(5.8) 


Next, fix e > 0, and choose M so that sup^. pk{K) < M and p{K) < M. Let 
Bs := {ccQ-l-a;! G K \ xq G null(Q), ||a:i ||2 < <5}, where ^ > 0 is chosen so that 
|g(a;)| < ef{2M) on Bs, which can be done since g is continuous and g{x) = 0 
on null((5)- By Theorem 15.11 supp((i/i) C Bs. Also, since Qk Q uniformly 
(Theorem 14.4|1 . it follows that, for k sufficiently large, null(Qfe) C Bs, and 
hence, supp{dpk) C Bs (Theorem [HI]). Thus for k large enough, we have 


/ g[dpk - dp) 

— 

/ g{dpk-dp)-G / g{Pk/Qk- PlQ)dx 

JK 


■IBs JK\Bs 


< 2M max |(;(a;)| -I- / \g\dx max \Pk/Qk — P/Q\- (5-9) 

xeBs JK\Bs xeK\Bs 


The first term is bounded by e (by the dehnition of Bs) and the second term 
tends to zero since Pk/Qk —>■ P/Q uniformly on K \ Bs. Since e > 0 is 
arbitrary, the limit of g{dpk — dp) \ as fc —>■ 00 of (15.91) is zero, and weak* 
convergence dpk dp follows. □ 
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In many classical one-dimensional moment problems, such as the power 
moment problem and the trigonometric moment problem, there will be can¬ 
cellation of common factors in P and Q. With more general basis functions 
this is not necessarily the case. In multidimensional generalizations of the clas¬ 
sical problems such cancelation may or may not occur. Example 15.51 shows 
a situation where there is cancelation, whereas no cancellation occurs in the 
next simple example. 

Example 5.10. Consider a two-dimensional power moment problem on K = 
[0,1]^ with basis functions a{x) = {\,xi,x\^X 2 ,x\,xiX 2 )'■ The polynomials 
P{x) = x\+x\ and Q{x) = xi + x\ + X 2 + X 2 are irreducible with a common 
zero in a; = (0,0)'. Moreover, 


showing that it is integrable. Set c := a^dx. Then (c, r) = R^dx > 0 
for all r £ *p_|_ \ {0}, so c G £+. Consequently, we have an example where 
c = 0 and both p and q belong to 9fp+, but there is no cancellation. 

6. Moments on the boimdary 

If c £ d€+, there is a go S ip+\{0} such that (c, go) = 0. Then Jp(Ago) ^ —00 
as A —!• 00 . Consequently, the functional (I4.1|l has no minimum. Then dp in 
HU cannot have a rational part. In fact, if dp is given by HU, then 



( 6 . 1 ) 


Since the first term is positive and the second in nonnegative, there could be 
no rational part in dp. Moreover, dp must have support in null((5o)- More 
precisely, we have the following representation (c.f.. Appendix A [31] )• 

Proposition 6.1. Suppose that 7 ^ 0. Then, for any c £ 9£+, there exists 
a dp € Wlc with support in at most n — 1 points in K. 

Proof. Since c £ £+, it follows from Proposition 12.41 that there is a. dp G dJtc 
with support in at most n points X\,X 2 , ■. ■ ,Xn- Then dp = X)"=i Ptdpi for 
some nonnegative coefficients jdi, where dpi = 5{x — xi) is the Dirac measure, 
for £ = 1, 2,..., n. If = 0 for some £, then dp has support in at most n — 1 
points, so only the case that /3^ > 0 for £ = 1, 2,..., n, remains. Now, since 
c £ i9£+, there is a p £ * 11 + \ {0} such that (c,p) = 0, i.e.. 



and hence {a{xi),... ,a{xn)} are linearly dependent. Therefore one of the 
measures dpi can be eliminated in the representation 
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proving that only a measure with support in n — 1 is needed. 


□ 


Next we provide the deferred proof of Theorem 12.31 which is based on 
Theorem 15.11 only. 

Proof of Theorem From Theorem 15.11 we know that a solution of (12.11) 
exists for all c € €+. Hence it just remains to show that there is a solution 
for all c G d€+. For any c £ d£+, let Cg = c + ecg, where cq G £+. The 
existence of such a cq is insured by Proposition 12.11 since ^ 0. Then 
Ce G £+ for all e > 0. Therefore, by Theorem 15.11 and the fact that ^ 0, 
we know that there exist a bounded measure G C{K)* of the form 
d^e = {P/Qe)dx + dfig such that 



for some p G tp+ \ {0}. Now, since 0, there is a po S ip+, and there is 

a i5 > 0 such that Po{x) > S for all x G K. Then 



However, {ce,po) = {c,po) +£(co,po) < M for some M and sufficiently small 
£. Hence Pe{K) < M/5 for all such e. Therefore there is a subsequence {dp^.} 
that converges to some dp in weak* [30l p. 128], [38l p. 246], and consequently 



which proves Theorem 12.31 


□ 


7. Appendix 

The following lemma, showing that 1° is bounded from below, is a direct 
generalization of Proposition 2.1 in [S], and the proof follows along the same 
lines as in [ 6 ]. 

Lemma 7.1. Let (c,p) G £+ x \ {0}. Then there are constants Cc, Cp > 0 
such that 


Ip{q) >ecllQlloo-eplogll(51|oo 


(7.1) 


for all <7 G \ {0}. 

Proof The linear form (c, 9 ) has a minimum, me, on the compact set {q G 
*P+ I II9II00 = !}• Since c G £+, me > 0. Hence for an arbitrary q G \ {0} 
we have 



CXD 


)lklloo > me\\q\\ 


00 • 


Next we observe that 


llQjjoo = maxQ = max \qk\\ak\ < M\\q\\ 

x^K x£K 
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where M := |Q;fc|. This maximum exists and is positive and finite, 

since the basis functions ai,a 2 , ■■■ ,an are continuous and K is compact. 
Consequently, taking ec := mdM > 0, we obtain 

(c,g) > edlQIloo- 

Next we consider the integral part of namely 

J P\ogQdx = J Plog^ ii^ ^ da: + log||Q||ooy Pdx. 

Since p G \ {0} is fixed, ep := Pdx > 0. Therefore 

Jrp(<7) > edlQIloo - J^Plog ^ dx - ep log (||Q||oo) • 

However, the integrand in the second term is nonpositive, and hence (dD 
follows. □ 

Lemma 7.2. Let c € £+, and let JJp(g) : *P+ —>■ K. U {oo} be the functional 
611). Then the optimal value Jp((j) = min^g^^ Jp(9) is continuous in p over 
^+\{ 0 }- 

Proof. Let pi,P 2 G *13+ \ {0} be arbitrary, and let ( 71,92 G *|l+ be the unique 
minimizers of JJp^ and JJ^^, respectively. Choose a (70 G such that 0 < 


IIQolloo < 00 . Then, by optimality, 

JJpi(gi) < JIpi (92 + ego) (7.2a) 

JIp 2 ( 92 ) < JIp 2 (91 + ego) (7.2b) 

for all e > 0. Therefore, if we could show that, for any d > 0, 

|Jp2(9i Tego) - Jpi(9i)| < (5 (7.3a) 

|Jpi(92 Tego) - Jp2(92)| < 5 (7.3b) 


for \\p 2 — Pill sufficiently small, we would have 

j;,(g 2 )-^<j;,(gi)<Ji;,(g 2 ) + ^, 

and the lemma would follow. To prove this, form 
IJpJ?! +£90) - Jrpi(gi)l 

= (c,eqo)- / P 2 log(Qi + eQo)(ia; + / PilogQida; 

Jk J k 

= (c, ego) - J Pi log ~ ~ T’l) log(Qi + eQo)dx 

<e^(c,go) + J Ri^c^x^ + 11^2 - Cillill log(Qi+eQo)||oo, 

where, by optimality of gi with respect to Pi^dx = (c, go) is finite. 

Here we can make the first term less or equal to 6/2 by choosing e sufficiently 
small. Then, set K{e) := 2|| log((5i +eQo)||oo, and take IIP 2 — T’lHi < 6/K{e), 
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from which (I7.3al) follows. The inequality (I7.3b|) follows by the same line of 
argument. □ 


Proposition 7.3. Let Ip{q) : R U { 00 } be the functional (14.111 . Then 

the function 


q = argmin Jp(g) 

i3e'P+ 

that maps p G *11+ \ {0} to q G *11+ is continuous for all values of c G £+. 


Proof. Let (pk) be a sequence in converging to p G *11+ \ {0} as fc —>■ 00 . 
Moreover, let qk = argmin^g^^ Then, by 

Lemma H751 the sequence {qk) is bounded, and hence there is a subsequence, 
which we also call {qk) converging to a limit qoo- Assume that goo 7 ^ <?, and 
choose a. qo G fp+ such that 0 < HQoHoo < 00 . Then 

Jpfc {qk) = {qk + ego) - (c, ego) + J log 

> Jpj, (gfc + ego) - (c,£go). 

Therefore, by Lemma 17.21 we have 

Jp(g) = lim Jpfc(gfc) > lim Jpjgfc + ego) - e(c,go). 

fC —rOO fC —rOO 

However qk + ego G *P+, and, since {p, q) 1 —>• JJp(p, g) is continuous in *(p+, we 
obtain 


Jlp(g) > ^lin^ JIpj, {qk + ego) - e(c, go) = JJp(goo + ego) - e(c, go) (7.4) 

Since the minimum min^g^^ •Tp(g) is unique fTheorem 14.4p . there is a (5 > 0 
such that Jlp(goo) — ^ > Jp(g), which together with (17.41) yields 

Jp(goo) - b> Ip{qoo + ego) - e(c, go) 

However by letting e: —0 we get —S > 0, which is a contradiction. Therefore 
limfc^oo qk = g, as claimed. □ 

Proposition 7.4. Let q := argmin^g^^ Jp(g)) where Ip{q) ■ R U { 00 } 

is the functional 611. Then the function sending c G £+ to q is continuous 
for all values of p G *P+ \ {0}. 

Proof. The proof is analogous to that of Proposition 17.31 We first prove that 
the optimal value JJp(g) = min^gqj^ JIp(( 7 ) is continuous in c over £+. To 
this end, let ci, C 2 € £+ be arbitrary, and let gi, g 2 G *11+ be the unique 
minimizers of and respectively. Next, exchanging for and 
for everywhere in the proof of Lemma |7.21 we see that it just remains to 
show that the absolute value of 

(ci,go)+ [ 

JK Wi 

can be made smaller than some preselected (5 > 0 by choosing an appropri¬ 
ately small £. This follows from the same argument as in Lemma 17.21 thus 
establishing the continuity of the optimal value. 


JIp^(gi -hego) - Jp^(gi) < ||gi||||c 2 -ci|| -he 
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Next, let (cfc) be a sequence in £+ converging to c € £+ as —>• oo, 
and let qk = arg min^gtp^ 1^'= (g) and q = argmin^g^^ Jp(g). Since (g^) is 
bounded, there is a subsequence, also called (g^) such that qk —>■ gcx)- We 
assume that goo g, and show that this leads to a contradiction. As in the 
proof of Proposition 17.31 we first note that 

Jp'' (qk) > Jp'' (qk + eqo) - £{ck, go) 
and hence, by the continuity of the optimal value of Jp in c, that 
Jp(g) = lim Jp'=(gfe)> lim (Jp'“ (gfc + ego) - e(cfc, go)) 

k—^oo k—^oo 

= Ip{q + eqo) -e(c,go), 

where we have used the fact that Ip is continuous in (c, g) G £+ x Then 
letting e —>■ 0 leads to a contradiction, proving that goo = g, as claimed. □ 


8. Errata 

The proof of the Lemma 3.1 in contains an error emanating from an in¬ 
correct use of the dominate convergence theorem, which invalidates Theorem 
1.10 in [^. The correct statement is the one-dimensional version of Theo¬ 
rem [O] in the present paper. 
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